A natural Hessian approximation for ensemble based optimization

نویسندگان

چکیده

Abstract A key challenge in reservoir management and other fields of engineering involves optimizing a nonlinear function iteratively. Due to the lack available gradients commercial simulators attention over last decades has been on gradient free methods or approximations. In particular, ensemble-based optimization gained popularity decade due its simplicity efficient implementation when considering an ensemble models. Typically, regression type approximation is used backtracking line search setting. This paper introduces Hessian utilizing Monte Carlo natural with respect covariance matrix. can further be implemented trust region approach order improve efficiency algorithm. The advantages using such approximations are demonstrated by testing proposed algorithm Rosenbrock synthetic field.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Two Level Approximation Technique for Structural Optimization

This work presents a method for optimum design of structures, where the design variables can he considered as Continuous or discrete. The variables are chosen as sizing variables as well as coordinates of joints. The main idea is to reduce the number of structural analyses and the overal cost of optimization. In each design cycle, first the structural response quantities such as forces, displac...

متن کامل

Preconditioning for Hessian-Free Optimization

Recently Martens adapted the Hessian-free optimization method for the training of deep neural networks. One key aspect of this approach is that the Hessian is never computed explicitly, instead the Conjugate Gradient(CG) Algorithm is used to compute the new search direction by applying only matrix-vector products of the Hessian with arbitrary vectors. This can be done efficiently using a varian...

متن کامل

Uncertainty Quantification for LDDMM Using a Low-Rank Hessian Approximation

This paper presents an approach to estimate the uncertainty of registration parameters for the large displacement diffeomorphic metric mapping (LDDMM) registration framework. Assuming a local multivariate Gaussian distribution as an approximation for the registration energy at the optimal registration parameters, we propose a method to approximate the covariance matrix as the inverse of the Hes...

متن کامل

Sequential Model-Based Ensemble Optimization

One of the most tedious tasks in the application of machine learning is model selection, i.e. hyperparameter selection. Fortunately, recent progress has been made in the automation of this process, through the use of sequential modelbased optimization (SMBO) methods. This can be used to optimize a cross-validation performance of a learning algorithm over the value of its hyperparameters. Howeve...

متن کامل

Improved Preconditioner for Hessian Free Optimization

We investigate the use of Hessian Free optimization for learning deep autoencoders. One of the critical components in that algorithm is the choice of the preconditioner. We argue in this paper that the Jacobi preconditioner leads to faster optimization and we show how it can be accurately and efficiently estimated using a randomized algorithm.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computational Geosciences

سال: 2023

ISSN: ['1573-1499', '1420-0597']

DOI: https://doi.org/10.1007/s10596-022-10185-z